A Formalization of Equilibria for Multiagent Planning
نویسندگان
چکیده
Traditionally, planning involves a single agent for which a planner needs to find a sequence of actions that can transform some initial state into some state where a given goal statement is satisfied. But in general, “planning” can be viewed as being concerned with a general action selection problem. The planning framework has been extended from the classical deterministic plan generation problem along many other dimensions, in particular nondeterministic actions. With the introduction of nondeterministic actions, the presence of an environment and other agents can become a consideration. In fact, actions may have nondeterministic effects not only because of the uncertainty of their own execution, but also due to the uncertainty of the actions of other agents. The possible presence of other agents as executors is the challenge of “multiagent planning.” The interest in this area has been steadily increasing and many issues remain open. Despite the existence of planning languages with explicit models of uncontrallable agents [Jensen and Veloso, 2000], we believe that there has not been a formal discussion of the space of multiagent plans or solutions. In this work, we do not focus on the problem of plan generation for multiagent planning. Instead, we focus on the interesting question of analyzing and comparing solutions for multiagent planning. Our motivation comes from making an analogy with game theory and the notion of equilibria [Owen, 1995]. Inspired by game theory and extending previous formal definitions of single-agent planning [Cimatti et al., 2000], in this paper, we introduce a formal definition of equilibria for multiagent planning.
منابع مشابه
Improved Planning for Infinite-Horizon Interactive POMDPs using Probabilistic Inference (Extended Abstract)
We provide the first formalization of self-interested multiagent planning using expectation-maximization (EM). Our formalization in the context of infinite-horizon and finitely-nested interactivePOMDP (I-POMDP) is distinct from EM formulations for POMDPs and other multiagent planning frameworks. Specific to I-POMDPs, we exploit the graphical model structure and present a new approach based on b...
متن کاملIndividual Planning in Infinite-Horizon Multiagent Settings: Inference, Structure and Scalability
This paper provides the first formalization of self-interested planning in multiagent settings using expectation-maximization (EM). Our formalization in the context of infinite-horizon and finitely-nested interactive POMDPs (I-POMDP) is distinct from EM formulations for POMDPs and cooperative multiagent planning frameworks. We exploit the graphical model structure specific to I-POMDPs, and pres...
متن کاملConstrained Pure Nash Equilibria in Graphical Games
The rational behavior of non-cooperative players is often formalized by means of the game theoretic notion of Nash equilibrium. However, there are several practical applications (e.g., multiagent planning, mechanism design, and routing protocols design), where the computation of any Nash equilibrium could not be satisfactory, since we are often interested only in equilibria that satisfy some ad...
متن کاملExistence of Multiagent Equilibria with Limited Agents
Multiagent learning is a necessary yet challenging problem as multiagent systems become more prevalent and environments become more dynamic. Much of the groundbreaking work in this area draws on notable results from game theory, in particular, the concept of Nash equilibria. Learners that directly learn an equilibrium obviously rely on their existence. Learners that instead seek to play optimal...
متن کاملLeveraging Repeated Games for Solving Complex Multiagent Decision Problems
Making good decisions in multiagent environments is a hard problem in the sense that the presence of several decision makers implies conflicts of interests, a lack of coordination, and a multiplicity of possible decisions. If, then, the same decision makers interact continuously through time, they have to decide not only what to do in the present, but also how their present decisions may affect...
متن کاملذخیره در منابع من
با ذخیره ی این منبع در منابع من، دسترسی به آن را برای استفاده های بعدی آسان تر کنید
عنوان ژورنال:
دوره شماره
صفحات -
تاریخ انتشار 2003